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Abstract 

A simple proof of the convergence of the variational regularization, with the regular- 
ization parameter, chosen by the discrepancy principle, is given for linear operators under 
suitable assumptions. It is shown that the discrepancy principle, in general, does not yield 
uniform with respect to the data convergence. An a priori choice of the regularization 
parameter is proposed and justified for some nonlinear operator equations. 



1 Introduction. 

In this note the convergence of the variational regularization with the regularization 
parameter chosen by the discrepancy principle is discussed for linear operators. In [1] 
and [2] one finds the references related to the discrepancy principle. 
Our assumptions in this Section are: 

i) A is a linear, bounded, injective operator on a Hilbert space H , the equation A(y) = 
f has a solution y, A' 1 is not continuous, so that (1.1) is an ill-posed problem, \ \fs — f\\ < 

M/*ll><*- 

Given {5, fs}, one wants to approximate y stably in the sense 

lini l| \Rsf s -y\\ = 0, (1.1) 

o— >0 

where R$ is an operator defined on all of H, a regularizer. Let F(u) := | \Au— fs\ \ 2 +a\\u\\ 2 , 
where a > is a parameter, and let u a be the solution to F{u a ) = infF(w). Existence 
and uniqueness of this variational problem are known: if B := A* A, then 

Uo = (S + a)- 1 A7 (5 , (B + a)u a = A*f s , (1.2) 

equation (1.2) is the Euler equation for F, it has a unique solution u a since B > and 
a > 0, and 

F(u a )<F(u), \\Au a - f 5 \\ 2 + a\\u a \\ 2 <5 2 + a\\y\\ 2 . (1.3) 



Assume fg _L N(A*), where N(A*) is the null-space of A*. This is done without loss of 
generality, since fs enters under the sign of A* in (1.2). The discrepancy principle (DP) 
(introduced by Morozov, see [1] and [2]) chooses a = a(5) as the root of the equation: 

h(a,5) := || Au a - f 5 \\ = C5, C = const > 1, \\f s \\ > S. (1.4) 

Note that N(Q) = N(A*), where Q := AA* > 0, and 

\\Au a -f 5 \\ = W^B + a)- 1 ^ = \\Q(Q + a)- 1 -I]fs\\ = a\\(Q + a)- 1 f 5 \\, 

where the known formula (B + a) -1 A* = A*(Q + a) -1 was used. 
Thus, 

h = a\\(Q + ay 1 f s \\. 

This implies that, for a fixed pair {fs,S}, the function h(a,5) in (1.4) is a monotone 
increasing function of a on (0, oo), lim a _>o h(a, 5) = 0, where we have used the assumption 
fs J- N(A*), and h(oo,5) = \\fs\\ > 8, so that (1.4) has a unique solution a = a(S), 

lim^o a ($) — 0. 

Define Rsfs '■= u$ := u a ^, where a(S) is given by the DP. 

Theorem 1.1. If A is compact, i) holds, and Rsfs := us, then (1.1) holds. 

Proof. From (1.4) and (1.3), with a = a(5) and u a := us, one gets 

IKII < IMI- (i-5) 

Thus, us — u (weak sequential convergence) as 5 — > 0, and Aus — > Au, because A is 
compact. From (1.3), with 5^0 and a — > 0, it follows that Au = f. By the injectivity 
of A, one gets u = y, so us — y as 5 — > 0. To prove that 

lim | |-U5 — y 1 1 = 0, (1.6) 

it is sufficient to prove that lim^o 1 1^| | = and this follows from (1.5) because ||y|| < 
liminf^o H M <5|| < limsup^g \\us\\ < The first inequality is the lower semicontinuity 
of the norm in H, and the last one follows from (1.5). Theorem 1.1 is proved. □ 
An alternative proof of (1.6) is based on the inequality 

\\u 5 -y\\ 2 <2^(y,y-us), (1.7) 

which follows from (1.5) easily. Since ug — y as 5 — > 0, (1.7) implies (1.6). □ 



2 Generalizations. 

2.1. One can drop the injectivity of A assumption and still get (1.6): 

If := N(A) is the null-space of A, Ay = f, and y _L N, then u$ := u a ^, defined in 
(1.2), has the property u$ J- N. Indeed, if G N, then (us,<f>) = (fs,A(B + a) _1 0) = 
(fs, (Q + a) _1 A0) = 0. Thus \im s _, us = u _L A. Since the problem 

Au = /, « JL A (2.1) 
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has only one solution, it follows that u = y. We have proved: 

Theorem 2.1. If N ^ {0} and y solves (2.1), then (1.6) holds. 

2.2. Let us drop both the compactness of A and the injectivity of A assumptions. 
Theorem 2.2. If A is a linear bounded operator, and y solves (2.1), then (1.6) 

holds. 

Proof. As above, one gets (1.5) with u$ := u a (s) defined by (1.2). Thus, u$ — 1 u and 
(B + a)us — > A* f as 8 — > 0, and this implies Bu = A* f . Indeed, B > is a monotone 
continuous operator, and therefore it is weakly closed, i.e., us ^ u and Bus 9 imply 
Bu = g. Recall that a = a(8) — > and u$ is bounded as 5 — > 0, so lim^o a(^)u<s = 0. 
Since / = Ay, one has B(u — y) = 0, and, since iV(I?) = N(A), one gets Att = Ay = f. 
We have already proved that u _L iV, thus u = y, and — 1 y as <5 — > 0. This and (1.7) 
imply (1.6). □ 

2.3. Let us drop the linearity of A assumption and propose an a priori choice of the 
regularization parameter. 

Consider the functional (cf [3]): 

F(u) := \\Au-fs\\ + 5\\u\\ h D(F) = H 1 , (2.2) 

where D(F) is the domain of F, the norm || • ||i is a norm of a Hilbert space Hi, which 
is dense in H, complete, and the imbedding i : Hi — > H is compact. Let 

m = m(5) := inf F(u), 

u 

and let u$ be any element such that 

F(u 5 ) <m + 5. (2.3) 

Theorem 2.3. Assume that A is a nonlinear, continuous, injective map, A' 1 is not 
continuous, f = A(y), y G H\, and (2.3) holds. Then (1.6) holds. 
Proof. Let F(u n ) — > m. Then for all sufficiently large n one has: 

m < \ \A{u n ) - f s \\ +<J|K||i < S + SWyWi := dS. (2.4) 

Choose us := u n such that (2.3) holds, and let 5^0. Since | \us\\i < ci, one has — > u, 
A(us) — > -A(u), and (2.4) shows that A(-u) = /. By the injectivity of A, one gets u = y, 
so (1.6) holds. □. 

3 DP does not yield uniform with respect to / con- 
vergence. 

In this Section the notations of Section 1 are used. 

Theorem 3.1 Let S$ := {v : \\Av — fs\\ < 8}, Us := u (5)> a ($) solves (1-4), A 
satisfies assumptions i) of Section 1, and N(A*) = {0}. 
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Then there are f§ such that 



lim sup | \u$ — v\ | > c = const > 0. (3.1) 



sec, 



Proof. Denote (B + a)- 1 A* := T, B := A* A, and u 5 = Tf s . Then ||T|| = 
e.g., [1]). Thus, there exists a p = p a , such that 

IM>3^, |WI = 0.M 

Let -R(A) denote the range of A. Since and R(B) are dense in H, and 7V(A*) = {0}, 
there is a z = z a such that 

H/a-AB^-pH < -, b = const e (0, 1) |H| = 0.55. (3.2) 

o 

For any i>, one has: 

< HT/i-TAull + llTAu-ull. (3.3) 

If v = B b z, then 

lim sup | \TAv — v\ \ = 0, (3.4) 

veS s ,v=B b z,\\z\\<M 

where M > is an arbitrary large constant, and we have used the following formulas: 
TAv -v = [(B + ay 1 B - I]B b z = -a(B + a)- l B b z, 



s 6 

\a(B + a)- 1 B h \ \ = a sup = ca b , c = b b {l - b) 1 ^ 

o<s<||si| s + a 



From (3.3) and (3.4) it follows that 

lim sup \\Tfs — v\\ — (3.5) 

S ^°veS s ,v=B b z, \\z\\<M 

if and only if 

lim sup \\Tf s -TAv\\ = 0. (3.6) 

S ^°v£S s ,v=B b z, \\z\\<M 

Choose v = B b z, where z := z a . Then, using the triangle inequality and (3.2), one gets: 

\\fs-Av\\<\\p\\ + S -<S, (3.7) 

and 

||r/ 5 -r^|| = mh -M,- P)+ T P \\ > > ^-^) - ^ (3.8) 



If one finds fs for which equation (1.4) has a root 

a = Cl 5 2 [l + o(l)], ci = const > 0, 5^0, (3.9) 

then > c = const > 0, and (3.8) implies that (3.6) fails, so (3.5) fails, and Theorem 
3.1 follows. 

There are infinitely many such f$. Let us construct one of them. Assume, for sim- 
plicity, that A = A*, so B = A 2 , and (1.4) is: 

00 00 

a2 E?d^ = ^ 2 > 9r-=\f*j\ 2 , X><°°, ( 3 - 10 ) 
j=i ^ / j=i 

where fij > are the eigenvalues of A 2 . Let gj = j~ 2 , fij = j -1 . Then, as we prove 
below, 

00 ._2 

^ := E (j -i + a) 2 =a- 1 [l + 0(a)} a^O. (3.11) 

If (3.11) holds, then (3.10) yields (3.9), and the argument is completed. 

To prove (3.11), define ip := x _2 (a;~ 1 + a)~ 2 dx, and, setting t = x^ 1 , one gets 

if>= [ (t + a)- 2 dt = a- 1 [l + 0(a)] a -> 0. 
Jo 

This and the estimate 

0- (1 + a)~ 2 < ip < (j), 

yield (3.11). □ 

In our construction, w :— fs ^ R{A) does not depend on 5, and / = Av$ is chosen 
for each 5 > in a 5— neighborhood of (see (3.7)), so that / depends on 5. The 
element vs = B b z a , a = a(S), cannot converge as 5 — > 0: if — * t> and Avs — > u> then, 
by the continuity of A, one has Av = w. This is a contradiction, since w ^ This 
contradiction proves that v$ cannot converge. If A is compact, then a similar argument 
proves that lim^o \\vg\\ = 00. 
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